These are the Photoshop animations I created to use as displacement maps for the sound waves.
very simple in PS. I just created the final size and ring shape with blurred edges. Added that as the last frame, duplicated it and scaled it down to use as the 1st frame, then tweened in between.
When there were multiple rings in the same animation I duplicated the layer and shifted the animation over.
Awesome to see all variations you’ve tried! I’ve some audio related models created as well and really should experiment with this kind of visualization of the sound waves. I’m not that familiar with video but it would be a cool thing to learn a bit more about DaVinci Fusion as well.
This is great!
As a few have noted already, the sound waves were a nice touch! That surprised me when watching the clip.
I know it’s a product showcase style clip, so the following may not apply, but personally I would have liked to see some ‘moodier’ lighting (something I’m working on myself). Maybe not the entire clip, but maybe as an intro before the scene lights up to the white background and clean studio lighting?
Most of the textures are procedural.
This one was created from a “mesh” texture, changed to a triangle pattern, inverted, and combined with a noise texture, and added to an emissive material.
I experiment with the material map frequently to generate unique material ideas.
I’ve adjusted the materials on the speaker drivers to add more interest, and also adjusted the animation slightly here.
Added 3D woven fabric for the driver spider.
I’ve synced up the bass sound waves to the bass kicks of the music. It wasn’t easy!
Re-rendered the whole animation over the last few days.
Works well with the bass synced! While not really disturbing me, this version feels more natural this way. Did you do it manually or found a nice trick which helped to get them aligned?
Hi @oscar.rottink
It was straightforward but not “easy”.
I used Ableton Live music software to analyse the track.
I then added markers where the bass kicks were.
Then, I measured the duration between the kicks.
Then, in Keyshot, I created a fake animation with no movement on a part and changed the animation length to match the measured time precisely.
I did that for both the short length and the long length, and then repeated the animation and aligned them.
I then aligned the fake animation with the first sound wave bass kick.
Then, I duplicated the fake animations to get something to align to.
I then realigned the sound wave bass kicks to this.
And repeated for the Auxiliary Bass Radiators (ABRs).
I created a low-resolution test animation and imported it into Clipchamp to check that it was in time with the music, which it was the first time. I then re-rendered the animation at 4K.
Not that complicated but quite some work, totally worth it! About a week ago I shortly looked into this to see if it was possible in DaVinci or AFX to output some greyscale image at the beat but it doesn’t seem to be that easy.
I found some tutorial where you basically convert the mp3/wav to a midi file since that could actually be used as a ‘trigger’ making use of the feature that you can make video react on simple midi signals. Didn’t really work for me yet, I got a flashing square but not exactly on a beat and that might be caused by the midi conversion which was done with some simple online tool.
Writing this, maybe I can try again by splitting the bass from the vocals and others using a local AI I’ve running, does a pretty excellent job and the midi file would be way simpler. Keep you posted if I figure something out.
I got now this far, the sound is just the MP3 but the flashes in the video get generated by a midi file after I used Demucs to split the bass from the other parts of the song.
After export the clip to images I have 5160 tiny images (no need for high res) which could drive something. Have to figure out if I can think of something creative to do with it.
This is the modifier page of the rectangle where I added a MIDI extractor to the level of the white rectangle which exposes these modifier settings.
I’ve not really a clue what most do but currently it will filter out any high pitch notes and make it all fade and go back to black after a certain decay time.
It’s more a proof of concept but might give you some other ideas as well.